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PREFACE 

AutoMan  is  a  microcomputer  program  designed  to  support  multi-criteria  decisions  about 
automated  manufacturing  investments.  It  was  developed  at  the  Center  for  Computing  and 
Applied  Mathematics  of  the  National  Institute  of  Standards  and  Technology  (NIST).  The 
project  was  conducted  in  collaboration  with  the  NIST  Automated  Manufacturing  Research 
Facility,  the  United  States  Navy,  and  Computer  Aided  Manufacturing-International  (CAM-I), 
a  consortium  of  manufacturing  firms. 

The  authors  wish  to  thank  all  those  who  contributed  excellent  ideas  and  suggestions 
incorporated  into  AutoMan.  Christoph  J.  Witzgall  of  NIST  verified  some  of  the  mathematical 
algorithms  for  computing  weights  and  ratings  from  pairwise  comparison  judgments.  The 
comments  of  NIST  reviewers  Belinda  L.  Collins,  Sieglmde  K.  Puller,  Harold  E.  Marshall,  and 
Rosalie  T.  Ruegg  inspired  many  useful  improvements  to  the  documentation  and  software. 
Volunteer  beta  testers  from  corporations,  universities,  profeSi^ional  associations,  and  the  CAM- 
I  Cost  Management  System  program  suggested  other  significant  enhancements  and  revisions. 
The  authors  are  particularly  indebted  to  Robert  Bennett  of  the  Accountancy  Department  of 
Northern  Illinois  University  and  Steven  Ncises  of  Woodward  Governor  for  their  very  careful 
review  and  testing  of  AutoMan  and  their  extensive  written  and  oral  suggestions  for  making 
the  product  more  useful  to  practicing  managers,  accountants,  and  engineers. 

Disclaimer:  Certain  trade  names  and  company  products  are  referenced  to  illustrate 

procedures.  In  no  case  do  these  references  imply  recommendation  or  endorsement 
by  the  National  Institute  of  Standards  and  Technology,  nor  do  they  imply  that  the 
products  are  necessarily  the  best  available  for  the  purpose. 
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ABSTRACT 


This  manual  documents  AutoMan,  a  microcomputer  program  designed  to  support  multi-criteria 
decisions  about  automated  manufacturing  investments.  The  program  permits  users  to  combine 
quantitative  and  qualitative  criteria  in  evaluating  investment  alternatives.  Quantitative 
criteria  could  include  such  traditional  financial  measures  as  Life-Cycle  Cost  and  Net  Present 
Value  as  well  as  such  engineering  performance  measures  as  throughput  and  setup  time. 
Qualitative  criteria  could  include  flexibility  and  product  quality.  First,  the  user  specifies  the 
evaluation  criteria  and  the  investment  alternatives  to  be  evaluated.  Second,  the  user  makes 
pairwise  comparisons  between  criteria  to  establish  their  weights.  Third,  the  user  rates  each 

investment  alternative  with  respect  to  the  criteria.  The  pairwise  comparison  process  helps  the 

user  rate  the  qualitative  criteria,  while  measured  performance  data,  such  as  cost,  setup  time, 
or  throughput,  can  be  entered  for  quantitative  criteria.  AutoMan  combines  ratings  with 
criteria  weights  into  an  overall  rating  for  each  investment  alternative  and  then  ranks 

alternatives.  Finally,  graphical  sensitivity  analysis  can  be  conducted  to  visualize  the  overall 

ratings  of  every  alternative  for  every  possible  weight  that  could  be  assigned  to  any  criterion. 
AutoMan  comes  with  sample  decision  models  and  a  manual  that  includes  a  detailed  tutorial,  a 
glossary  of  evaluation  criteria,  a  bibliography,  and  an  index. 

Key  Words;  Analytic  hierarchy  process;  automation;  automated  manufacturing;  decision  support 
software;  economic  evaluation;  microcomputer  software;  multi-criteria  decisions;  performance 
measures;  qualitative  data;  sensitivity  analysis. 
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HOW  TO  INSTALL  AND  START  AUTOMAN  2.0 


AutoMan  2.0  runs  on  an  MS-DOS^°*  microcomputer  with  at  least  640  kilobytes  of  RAM  and  a 
floppy  diskette  drive.  The  new  sensitivity  an^ysis  feature  requires  a  graphical  monitor  and 
adapter  card  with  one  of  the  following  resolutions:  Hercules^™  (720x348),  CGA  (640x200), 
EGA  (640x350),  or  VGA  (640x480).  Prmting  a  Sensitivity  Analysis  graphic  requires  a  graphical 
printer  (i.e.,  a  laser  or  dot  matrix  but  not  a  daisy  wheel  printer).  AutoMan  may  be  run 
directly  from  a  360  kilobyte  floppy  drive  or  it  may  be  first  installed  on  a  hard  drive  and  then 
run  from  there. 

Users  of  the  original  version  of  AutoMan  should  note  that  the  procedure  for  installing 
AutoMan  2.0  on  a  hard  drive  will  upgrade  your  software  while  preserving  all  your  data  files. 


To  run  from  a  floppy  drive: 

Insert  the  distribution  diskette  into  a  floppy  drive  that  is  write-compatible  with  the 
distribution  diskette  (e.g.,  drive  A),  type  A:  and  press  to  go  to  the  A  drive. 
To  run  the  program,  type  AUTOMAN  and  press  4-‘,  or  AUTOMAN  M  for 
Monographic  systems  like  the  Compaq*™  Portable  II  or  III.  To  run  AutoMan  from  a 
high  density  1.2  megabyte  floppy  drive,  you  must  first  copy  all  the  files  from  the 
distribution  diskette  to  a  write-compatible  high  density  diskette.  If  you  have  a 
hard  drive,  AutoMan  will  run  much  faster  if  you  install  it  on  the  hard  drive. 


To  install  on  a  hard  drive: 

Insert  the  diskette  into  any  floppy  drive  (e.g.,  drive  A),  type  A:  and  prf;ss  to  go  to 
the  A  drive.  Then  type  INSTALL  to  install  AutoMan  on  the  C  drive.  Press  and 
the  installation  will  begin.  All  of  the  AutoMan  program  and  data  files  will  be 
automatically  copied  to  a  directory  called  \AUTOMAN  on  the  C  drive.  To  install 
AutoMan  on  a  drive  other  than  C,  specify  the  drive  letter  (e.g.,  type  INSTALL  D  to 
install  AutoMan  on  drive  D). 


To  run  from  a  hard  drive; 

Go  to  the  directory  in  which  AutoMan  is  installed  by  typing  CD\AUTOMAN  and 
pressing  ■♦-*.  Then  type  AUTOMAN  and  press  or  AUTOMAN  M  for 
Monographic  systems  like  the  Compaq*™  Portable  II  or  III. 


The  AutoMan  2.0  distribution  diskette  contains  these  files: 
AUTOMAN.EXE  Executable  program. 

MODELIST.DBF  Data  file  of  model  names. 

*.DBF  -  Several  data  files  containing  sample  models. 

PRINT.SET  -  Parameter  file  for  your  graphical  printer. 
PRX_TBL.BIN  -  File  of  printer  driver  data  for  most  printers. 
*.@  -  Two  font  files  for  graphical  sensitivity  analysis. 

INSTALL.BAT  -  Batch  file  to  install  AutoMan  on  a  hard  disk. 
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1.  INTRODUCTION 


Most  capital  investment  decisions  are  made  using  such  traditional  measures  of  financial  worth 
as  net  present  value,  life-cycle  cost,  and  return  on  mvestment.  These  measures  incorporate 
the  stream  of  costs  and  benefits  of  an  investment  over  time  into  a  single  measure.  The 
measures  are  either  denominated  in  dollars  or  derived  from  dollar-denominated  data.  Hnancial 
worth  measures  are  often  applied  to  reduce  costs  such  as  labor,  materials,  inventory,  and 
rework.  They  tend  to  focus  more  on  cost  reduction  than  revenue  creation  because  the  former 
is  usually  easier  to  quantify. 

Measures  of  financial  worth  are  often  inadequate  to  evaluate  investments  in  automated 

manufacturing.  The  shortcomings  of  relying  solely  on  these  measures  when  evaluating 
automated  manufacturing  investments  are  discussed  throughout  the  literature.^  The  most 
pervasive  complaint  is  that  measures  of  fmancial  worth  fail  to  account  fully  for  the 
nonfinancial  impacts  of  these  investments.  Nonfinancial  impacts  may  be  either  quantitative  or 
qualitative.  Nonfinancid  quantitative  impacts  can  be  measured,  but  not  easily  converted  to 
dollars.  They  may  consist  of  non-monetary  measures  of  performance  such  as  throughput,  cycle 
time,  and  schedule  attaimnent.  Qualitative  impacts  cannot  be  measured  at  all.  They  typically 
involve  issues  that  affect  the  long-term  or  strategic  position  of  the  firm,  such  as  technology 

advancement,  plant  modernization,  product  quality,  flexibility,  competitive  position,  and  even 

the  survival  of  the  firm. 

Although  industrial  managers  recognize  the  need  for  analytical  techniques  that  account  for 

nonfinancial  impacts,  there  has  been  little  change  in  the  way  most  automated  manufacturing 
investment  decisions  are  made.  Indeed,  in  a  1984  survey  of  the  National  Electrical 

Manufacturers  Association,  91  percent  of  busmess  executives  reported  using  traditional 
measures  of  rinandal  worth  as  the  major  criteria  for  automation  mvestment  decisions 

(Sullivan,  1986,  pp.  42-50). 

Approaches  that  include  more  than  one  measure  of  performance  in  the  evaluation  process  are 
multi-attribute  or  multi-criteria  decision  methods.^  The  advantage  of  these  methods  is  that 
they  can  account  for  both  financial  and  nonfinancial  impacts.  The  Analytic  Hierarchy  Process 
(AHP)  is  one  multi-criteria  decision  method  that  has  recently  gained  in  popularity  and  been 

applied  to  a  wide  variety  of  complex  decision  problems.  The  AHP  technique  was  developed  in 

the  1970’s  by  Thomas  L.  Saaty  at  the  Wharton  School  of  the  University  of  Pennsylvania.^ 

The  AHP  structures  a  complex  decision  into  a  hierarchy  of  its  elements.  It  then  establishes 
shares  of  influence,  or  relative  weights,  among  the  elements  through  a  sequential  process  of 
pairwise  comparisons.  Pairwise  comparisons  are  based  on  judgments  about  relative  differences 
between  comparable  elements.  The  relative  weights  are  combined  to  derive  a  single  overall 
rating  for  each  decision  alternative. 


^For  example,  see  Fred  Choobineh,  "Justification  of  Flexible  Manufacturing  Systems,"  in 
Choobineh  (1986,  pp.  269-281),  Computer  Aided  Manufacturing-International,  Inc.  (19^),  Jellnek 
(1986),  Sullivan  (1986),  and  Canada  and  Sullivan  (1989). 

^For  more  information  on  multi-criteria  decision  methods,  see  21eleny  (1982),  Goicoechea 
et  al.  (19821.  and  Canada  and  Sullivan  (1989). 

^For  information  on  the  AHP,  see  Saaty  (1988)  and  Gass  (1985). 


One  of  the  major  strengths  of  the  AHP  is  that  it  permits  inconsistencies  among  the  pairwise 
comparison  judgments.  For  example,  A  need  not  be  four  times  as  important  as  C  just  because 
A  is  tmee  as  important  as  B  and  B  is  twice  as  important  as  C.  In  technical  terms,  this 
means  that  the  user  is  not  forced  to  preserve  carding  transitivity  among  comparisons.  The 
AHP  even  provides  an  explicit  measure  of  inconsistency  that  indicates  how  far  the  pairwise 
judgments  deviate  from  perfect  cardinal  transitivity. 

Several  shortcomings  of  the  AHP  are  discussed  in  the  literature.  The  major  aiticisms 
question  the  lack  of  a  theoretical  framework  for  modeling  decision  problems  into  a  hierarchy 
(Zahedi,  1986,  p.  102),  the  use  of  subjective  Judgments  in  making  pairwise  comparisons  (Reeve, 
1988,  pp.  26-27),  the  use  of  the  eigenvector  method  for  estimating  relative  weights  (Zahedi, 
1986,  p.  103),  and  the  lack  of  a  formal  treatment  of  risk  (liarker,  1988). 

Despite  its  limitations,  the  AHP  appears  ideally  suited  for  economic  decisions  on  automated 
manufacturing  investments.  It  incorporates  into  a  unified  analytic  framework  a  wide  variety 
of  normally  incommensurable  impact  criteria,  some  of  which  may  be  financial,  some 
nonfinandal  yet  quantifiable,  and  some  qualitative.  It  appeals  to  decision  makers  because  they 
directly  participate  in  the  process  and  can  generally  understand  how  results  are  produced. 
Furthermore,  it  has  the  advantage  of  dealing  formally  with  inconsistency  in  human  judgments. 
Some  researchers  have  already  begun  applying  the  AHP  to  automated  manufacturing  investment 
decisions.^ 

This  manual  describes  the  microcomputer  program  AutoMan,  a  special-purpose  adaptation  and 
modification  of  the  AHP  designed  to  support  investment  decisions  about  automated 
manufacturing  equipment.  AutoMan  is  useful  for  selecting  the  best  investment  in  automated 
manufacturing  equipment  and  for  ranking  a  set  of  investment  alternatives.  AutoMan  requires 
that  the  investment  alternatives  be  identified  and  well  spedlied  beforehand.  If  financial 
worth  measures  are  to  be  factors  in  the  decision,  AutoMan  requires  that  these  measures  have 
been  separately  estimated.  Similarly,  actual  performance  data  or  qualitative  judgments  must  be 
available  on  the  merits  of  each  alternative  with  respect  to  nonrinancial  evaluation  criteria  to 
be  used  in  the  decision. 

AutoMan  evaluates  up  to  seven  investment  alternatives  simultaneously.  If  there  are  more  than 
seven  alternatives,  you  can  evaluate  them  in  groups  of  seven,  and  then  reevaluate  those  that 
rank  high  in  each  group  against  one  another.  The  outcome  of  this  procedure,  however,  is 
sensitive  to  the  way  alternatives  are  initially  grouped.  AutoMan  evaluates  either  (1)  mutually 
exclusive  alternatives  (i,e.,  select  only  one)  or  (2)  non-mutually  exclusive  alternatives  (i.c., 
select  more  than  one)  as  long  as  the  alternatives  are  independent  of  each  other  (i.e.,  their 
impacts  are  not  affected  by  acceptance  of  other  alternatives). 

AutoMan  may  be  used  to  arrive  at  a  team  decision  requiring  input  from  senior  managers, 
accountants,  financial  analysts,  and  engineers.  Senior  managers  could  structure  the  decision 
into  a  hierarchy  of  its  elements  and  establish  priorities  among  the  elements;  accountants  and 
tinancial  analysts  could  develop  fmancial  data  for  the  investment  alternatives;  and  engineers 
could  provide  the  nonfmancial  data  and  judgments  on  the  performance  of  alternatives. 

Although  AutoMan  is  designed  for  selecting  investments  in  automated  manufacturing 
equipment,  it  is  applicable  to  a  wide  variety  of  decision  problems.  AutoMan  is  appropriate  for 
supportii^  any  multi-criteria  decision  involving  both  quantitative  and  qualitative  evaluation 
criteria. 


^For  examples,  see  Arbel  and  Seidmann  (1984),  Varney  (1985),  Sullivan  (1986), 

Wabalickis  (1^),  Canada  and  Sullivan  (1989),  and  Troxler  and  Bla^  (1989). 
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2.  OVERVIEW  OF  AUTOMAN 


The  overview  of  AutoMan  summarizes  the  general  procedures  and  gitiding  principles  to  follow 
when  building  and  applying  decision  models.  The  details  and  mechanics  of  using  the  program 
are  illustrated  in  the  Tutorial  that  follo^vs  in  Section  3. 

Using  AutoMan  to  support  a  decision  regarding  automated  manufacturing  investment 

alternatives  involves  four  steps.  First,  identify  evaluation  criteria,  group  them  into  logical 
categories,  and  name  the  investment  alternatives  for  evaluation.  Second,  make  pairwise 

comparisons  to  establish  the  relative  importance  of  categories  as  well  as  of  evaluation 

criteria  within  each  category.  Third,  rate  alternatives  with  respect  to  each  criterion.  For 

measurable  criteria,  use  actual  performance  data  for  rating.  For  qualitative  criteria,  use  the 
pairwise  comparison  method.  Fourth,  let  AutoMan  combine  the  ratings  for  each  investment 
alternative  with  the  criteria  weights  and  rank  alternatives  by  their  overall  ratings. 


2.1  Build  a  Model 

In  the  fu-st  step  you  se*ect  an  existing  decision  model  or  build  a  new  one.  The  model 
structure  is  a  three-tier  hierarchy  consisting  of  a  topmost  tier  of  "categories,"  a  middle  tier 
of  "criteria,"  and  a  bottom  tier  of  investment  "alternatives."  A  new  model  is  built  by 
identifying  the  evaluation  criteria  to  be  considered  in  the  decision,  grouping  similar  criteria 
into  categories,  and  labeling  the  investment  alternatives  to  be  evaluated. 

The  evaluation  criteria  comprising  the  middle  tier  are  the  expected  impacts  of  the  investment 
alternatives,  both  quantitative  and  qualitative.  All  significant  impacts  should  be  fully  reflected 
in  the  choice  of  evaluation  criteria.  The  criteria  should  be  selected  and  defined  to  avoid 
ambiguity  and  redundancy. 

Similar  evaluation  criteria  are  grouped  into  categories,  defining  the  topmost  tier  of  the  model. 
The  three  basic  types  of  impacts  discus.sed  in  Section  1  -  financial,  nonfinancial  quantitative, 
and  qualitative  -  are  helpful  in  grouping  evaluation  criteria  into  categories. 

Models  will  not  necessarily  group  criteria  into  categories  exactly  matching  the  three  basic 
types  of  impacts.  For  example,  one  model  may  group  cost-related  financial  criteria  in  one 
category,  benefit-related  financial  criteria  in  another,  nonfinancial  quantitative  criteria  in  a 
third,  and  qualitative  criteria  in  a  fourth.  Combining  different  types  of  criteria  (e.g.,  financial 
and  qualitative)  in  a  single  category  is  not  recommended  because  of  the  potential  difficulty  in 
comparing  the  criteria.  Keep  in  mind,  however,  that  AutoMan  lets  you  create  any  grouping. 
The  only  limits  are  no  more  than  seven  categories  of  evaluation  criteria  with  up  to  seven 
criteria  per  category,  for  a  total  of  49  criteria. 

In  building  models,  the  evaluation  criteria  within  each  category  must  be  reasonably  comparable 
-  no  criterion  should  be  more  than  ten  times  as  important  as  any  other  criterion  in  that 
category.  If  a  criterion  is  more  than  ten  times  as  important  as  another,  it  should  be 
reclass’fied  into  another  category  or  redefined  and  decomposed  into  several  criteria.  On  the 
other  hand,  if  a  criterion  is  less  than  one  tenth  as  important  as  any  other,  it  probably  is  not 
significant  enough  to  warrant  inclusion  in  the  analysis.  Similarly,  the  categories  themselves 
must  be  reasonably  comparable. 
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Once  the  categores  and  criteria  have  been  developed,  the  investment  alternatives  are 
identifled.  The  investment  alternatives  should  be  sufficiently  specified  so  that  you  can  at 
least  make  reasonable  judgments  as  to  relative  performance  with  respect  to  all  the  aiteria. 
farther,  since  retaining  the  existing  manufacturing  system  may  possibly  be  preferred  to  all 
new  investment  alternatives,  the  existing  system  should  be  included  in  the  list  of  mvestment 
alternatives.  The  alternatives  may  be  either  mutually  exclusive  (i.e.,  select  only  one)  or  non- 
mutually  exclusive  alternatives  (i.e.,  select  more  than  one)  as  long  as  the  alternatives  are 
independent  of  each  other.  Seven  alternatives  may  be  evaluated  simultaneously.  For  more 
than  seven  alternatives,  evaluate  them  in  groups  of  seven,  and  then  re-evaluate  those  that 
rank  high  in  each  group  against  one  another.  The  initial  grouping,  however,  may  influence 
the  outcome  of  this  procedure. 

Building  the  decision  model  is  one  of  the  most  important  and  difficult  steps  in  AutoMan.  To 
help  you  get  started,  the  program  offers  three  sample  models,  any  one  of  which  may  be  used 
as  a  template  from  which  to  develop  a  more  suitable  model.  These  models  are  provided  only 
to  illustrate  different  structures;  such  generic  models  are  unlikely  to  articulate  a  particular 
organization’s  goals  and  strategies.  All  the  sample  models  contain  categories  and  criteria  but 
only  the  model  EXAMPLE  contains  data  on  wei^ts  or  ratings.  The  dat?  in  EXAMPLE  are  by 
definition  purely  hypothetical  because  weights  and  ratmgs  need  to  be  specific  to  a  particular 
decision-making  environment. 

To  further  help  you  build  models,  the  Glossary  in  the  back  of  the  manual  defines  those 
criteria  for  evaluating  automated  manufacturing  investments  that  are  used  in  the  sample 
models  of  AutoMan.  Refer  to  the  Glossary  for  criteria  to  consider  when  building  a  new  model 
and  revise  and  add  to  the  definitions  to  meet  the  needs  of  your  organization. 


2.2  Weight  Categories  and  Criteria 

The  second  step  derives  weights  for  categories  and  then  for  the  mdividual  criteria  in  each 
category.  The  weights  are  critical  because  they  establish  the  relative  importance  of  each 
criterion  to  the  overall  decision.  The  importance  of  each  criterion  to  the  overall  decision 
depends  on  its  "share,"  which  is  the  product  of  the  criterion  weight  and  the  weight  for  the 
category  to  which  the  criterion  belongs.  The  criteria  shares  all  sun  to  imity.  In  general,  the 
more  criteria  in  a  model,  the  less  important  is  each  criterion  to  the  overall  decision. 

The  weights  are  based  on  your  judgments  about  the  relative  importance  of  criteria  when 
compared  in  a  pairwise  fashion.  If  there  are  n  elements  (categories  in  the  model  or  criteria 
within  a  category)  to  be  weighted,  then  there  are  only  n(n-l)/2  pairwise  comparisons  to  be 
made.  Thus,  4  evaluation  criteria  require  6  (=  4x3/2)  comparisons.  This  is  because  of  two 
assumptions;  (1)  each  criterion  is  of  equal  importance  to  itself;  and  (2)  if  A  is  twice  as 
important  as  B,  then  B  is  half  as  important  as  A.  The  procedure  for  comparing  criteria  is  the 
same  as  that  for  comparing  categories.  When  all  the  pairwise  comparisons  are  entered, 
AutoMan  derives  a  system  of  weights  that  sum  to  unity  by  computing  the  normalized 
eigenvector  of  the  largest  eigenvalue  of  the  matrix  of  pairwise  comparison  values.^  This 
approach  establishes  the  relative  importance  of  categories  as  well  as  criteria  within  each 
c.ategory. 


^AutoMan  computes  the  normalized  eigenvector  by  raising  the  matrix  of  pairwise 
comparisons  to  powers  that  are  successively  squared  each  time.  This  is  the  computational 
method  suggested  by  Saaty  (1988,  p.  179). 
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In  addition  to  the  weights,  AutoMan  reports  an  Inconsistency  Ratio.  As  indicated  in  Section 
1,  the  pairwise  comparison  method  lets  you  reveal  their  inconsistencies  of  judgment.  Perfect 
consistency  results  when  A  is  always  judged  to  be  four  times  as  important  as  C  if  A  is  twice 
as  important  as  B  and  B  is  twice  as  important  as  C.  The  Inconsistency  Ratio  measures  how 
far  all  the  pairwise  judgments  deviate  from  perfect  consistency  among  all  comparisons.  If  the 
Inconsistency  Ratio  exceeds  0.10,  it  is  advisable  to  redo  the  pairwise  comparisons.  Otherwise, 
the  overall  ratings  may  be  distoited.  The  Tutorial  illustrates  a  convenient  method  to  force 
any  comparison  value  to  be  perfectly  consistent.  The  best  way  to  improve  consistency, 
however,  is  to  make  belter  informed  comparisons  based  on  more  information  gathered  either 
through  research  or  expert  judgment  of  others. 


2.3  Rate  Alternatives 

The  third  step  in  AutoMan  is  to  rate  each  investment  alternative  with  respect  to  every 
criterion  in  the  model.  There  are  lwo  rating  methods:  pairwise  comparison  and  direct  entry 
of  performance  data.  The  pairwise  comparison  method  is  the  same  as  that  used  in  Step  2  for 
establishing  the  relative  importance  of  criteria.  The  only  difference  is  that,  rather  than 
being  asked  to  compare  the  importance  of  criteria,  you  are  asked  to  compare  the  desirability 
of  investment  alternatives  with  respect  to  each  criterion.  The  pairwise  comparison  method 
must  be  used  for  rating  if  ihere  are  no  reliable  performance  data  on  the  alternatives  for  the 
criterion. 

The  performance  data  method  requires  actual  data  on  the  performance  of  each  alternative  with 
respect  to  the  criterion.  The  data  must  be  either  directly  or  inversely  proportional  to  the 
desirability  of  each  alternative.  For  example,  revenue  is  directly  proportional  if  $200  of 
revenue  is  considered  twice  as  desirable  as  $100  of  revenue.  Scrap  costs  are  inversely 
proportional  if  $200  of  cost  is  considered  half  as  desirable  (twice  as  bad)  as  $100  of  cost. 
Negative  and  zero  values  have  no  meaning  and  are  ignored  in  deriving  ratings  since 
performance  data  must  be  proportional  to  desirability.  The  units  in  which  the  data  are 
entered  do  not  matter  as  long  as  the  same  units  are  used  for  each  alternative  within  the 
criterion  bemg  evaluated  by  the  performance  data  method. 

Once  the  performance  data  are  entered,  AutoMan  computes  a  set  of  ratings  for  the 
alternatives  that  sum  to  unity.  For  directly  proportional  data,  the  rating  for  each  alternative 
is  the  ratio  of  its  performance  data  value  to  the  sum  of  the  performance  data  values  for  all 
alternatives.  For  inversely  proportional  data,  the  rating  is  the  ratio  of  the  inverse  of  the 
alternative’s  performance  data  value  to  the  sum  of  the  inverses  of  the  data  values  for  all 
alternatives.  This  approach  establishes  the  relative  desirability  of  the  alternatives  with 
respect  to  each  criterion. 


2.4  Compute  Overall  Ratings 

The  final  step  in  the  process  is  carried  out  by  AutoMan.  All  weights  developed  for  the 
criteria  are  combined  with  ratings  to  compute  a  single,  weighted-average  rating  for  each 
alternative.  The  overall  ratings  are  displayed,  and  all  alternatives  are  ranked  by  them.  The 
alternative  with  the  highest  overall  rating  is  the  best  choice  taking  mto  account  the  relative 
importance  of  each  criterion  established  by  the  user  in  Step  2  as  well  as  the  relative 
desirability  of  the  alternatives  with  respect  to  each  criterion  in  Step  3. 

If  the  decision  involves  non-mutually  e.xclusive  alternatives  (i.e.,  more  than  one  may  be 
selected),  then  the  ranking  by  overall  rating  can  be  used  to  select  the  top  set  of  alteruatives. 
If  there  are  more  than  seven  alternatives  to  evaluate,  then  a  copy  of  the  model  may  be  made 
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to  cover  the  other  alternatives.  The  user  may  then  redefine  the  set  of  investment 
alternatives  and  keep  the  same  categories  and  criteria.  The  new  copy  of  the  model  will  start 
out  with  the  same  pairwise  comparison  data  and  resulting  weights  as  the  original  model.  The 
new  model  will  have  a  new  set  of  alternatives  which  will  require  new  ratings  to  be  established 
for  the  alternatives  with  respect  to  each  criterion.  Provided  the  alternatives  are  grouped  so 
that  the  better  ones  are  not  all  clustered  into  the  same  model,  the  overall  ratings  could  be 
used  to  establish  an  approximate  ranking  of  all  the  alternatives. 


2.5  Conduct  Sensitivity  Analysis 

The  sensitivity  analysis  feature  requires  a  graphical  monitor  and  adapter  card  with  one  of  the 
foUowing  resolutions:  Hercules  (720x348),  CGA  (640x200),  EG.\  (640x350),  or  VGA  (640x480). 
Press  C  from  the  AutoMan  Menu  to  select  Compute  Overall  Ratings  and  then  S  to  select  the 
Sensitivity  Analysis  option.  Then  move  the  light  bar  to  the  criterion  on  which  you  want  to 
conduct  sensitivity  analysis  and  select  it  by  pressing  .  A  graphic  screen  will  appear 
displaying  the  results  of  the  sensitivity  analysis. 

The  sensitivity  analysis  screen  plots  a  set  of  straight  lines,  each  representing  one  of  the 
alternatives  being  evaluated  in  your  decision  model.  The  horizontal  axis  gives  the  percentage 
share  of  importance  (weight)  of  the  criterion  being  analyzed.  The  vertical  axis  gives  the 
Overall  Ratings  of  the  alternatives.  For  reference,  the  current  percentage  share  is  marked 
with  a  vertical  line.  In  this  one  graph  you  can  see  the  Overall  Ratings  of  every  alternative 
for  every  possible  percentage  share  assigned  to  the  criterion  of  interest.  The  points  where 
the  Imes  intersect  the  lsf(.  axis  (the  share  is  zero)  indicate  how  alternatives  would  be  rated  if 
this  criterion  were  totally  iimored  and  all  weight  formerly  attributed  to  it  were  redistributed 
proportionately  to  the  remaining  criteria.  The  points  where  the  liues  intersect  the  right  axis 
(the  share  is  100  percent)  indicate  how  alternatives  would  be  rated  if  this  were  the  only 
criterion  that  mattered  and  all  other  criteria  were  ignored.  Breakeven  points  occur  where  the 
plots  of  two  alternatives  intersect.  The  rankings  of  the  two  alternatives  reverse  when  the 
criterion  share  moves  from  one  side  of  a  breakeven  point  to  the  other. 

Printing  a  Sensitivity  Analysis  graphic  requires  a  graphical  printer  (laser  or  dot  matrix,  but 
not  a  daisy  wheel).  When  you  fi^st  tr}'  to  print  a  graphic,  you  are  asked  to  select  a  printer 
and  to  set  several  printer  parameters.  Scroll  through  the  list  of  printer  definitions  available 
to  highlight  the  proper  one  and  select  it  by  pressing  4-'.  If  your  printer  is  not  listed,  try 

an  Epson^™  for  a  dot  matrix  or  a  Hewlett  Packard™  for  a  laser.  Then  set  the  size  and 

margins  of  the  printed  graph.  The  default  orientation  of  the  printed  graph  is  Portrait  (i.e., 
with  the  graph  title  parallel  to  the  short  edge  of  the  paper).  Answer  N  to  select  Landscape 
orientation  (i.e.,  title  parallel  to  the  long  edge  of  the  paper).  Finally,  set  whether  the.  printer 
will  force  a  form  feed  to  eject  the  paper  after  printing.  You  can  later  change  these  settings 
by  pressing  P  for  Printer  Setup  from  the  Sensitivih/  Analysis  Screen.  You  can  change  the 
printer  by  pressing  F2  from  the  Printer  Setup  screen.  If  the  graphical  printing  does  not  work 
on  your  printer,  try  running  the  utiiity  program,  GRAPHICS.COM,  which  comes  with  most 

versions  of  DOS  before  starting  AutoMan.  Then  press  Shift-PrtScr  to  screen  dump  the  image 

displayed  on  the  screen. 
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3.  TUTORIAL 


Tiie  Tutorial  shows  how  to  use  AutoMao  to  evaluate  alternative  investments  in  automated 
manufacturing  equipment.  The  four  major  steps  outlined  m  Section  2  are  illustrated  in  detail. 

The  instructions  throughout  the  Tutorial  and  at  the  bottom  of  each  screen  in  the  program  use 
a  common  set  of  symbols  to  represent  keystrokes  that  perform  specific  actions.  The  symbols, 
keystrokes,  and  resulting  actions  are  as  follows: 


Symbol 

Keystroke 

Resultinfl  Action 

■4-1 

Enter  key 

Enter  data  or  redo  comparisons 

-4  ^ 

Right  and  left  arrow  keys 

Move  within  an  element 

Tl 

Up  and  down  arrow  keys 

Move  between  elements 

Del 

Delete  key 

Delete  a  character  or  delete  a  model 

CtrlY 

Hold  down  the  Control  key 
and  press  Y 

Delete  an  element 

Ctrl- 

Hold  down  the  Control  key 

View  the  criteria  or  view  the  ratings 

Home 

and  press  Home 

Ctrl- 

Hold  down  the  Control  key 

View  Inconsistency  Ratios  and  shares 

End 

and  press  End 

Eec 

Escape  key 

Cancel  current  action  or  retreat  to  previous  level 

To  start  AutoMan: 

»  Type  CO\AUTOMAN  and  press  *-> . 

«  Tjpe  AUTOMAN  and  press  . 

0  When  the  opening  screen  appears,  press  ♦-J . 

The  AutoMan  Menu  appears  with  four  options  corresponding  to  four  steps  required  to 
evaluate  alternative  investments  (Exhibit  1). 


nuxnnnn 


Salact  o£  Build  a  Medal 
Walsht  Catasorlaa  &  Crltarla 
Rata  Altarnatlvaa 
Cocoputa  Overall  Ratings 
Quit  AutoMan 

Modal  Saleotad:  HONE 

FI  for  Help  1  f  to  Move  4—*  to  Salact 


ExhibK  1.  AutoMan  Menu. 
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Press  FI  at  the  AutoMan  Menu  for  a  summary  of  the  four  ms\jor  steps  or  modules  (Exhibit  2). 
Throughout  AutoMan  press  FI  to  see  help  screens  that  explain  the  current  procedures. 


M«in  Modules  of  AutoMsn 


Select  01  Build  e  Model 

Identify  eveluatlon  criteria,  them  Into  lo(loal  categories, 

and  specify  Inveatoant  eltamatlvas  to  be  evaluated. 

Weight  Categories  &  Criteria 

Enter  palrwlae  oomparlaone  Into  Judgment  matrices  to  aatabliah  the 
relative  Importance  of  categories  as  wall  as  of  evaluation  criteria 
within  each  category. 

Rate  Altematlvee 

Rata  eltematlvea  with  respeot  to  each  criterion.  Tot  moaeurabls 
criteria,  use  actual  parforaiance  data.  Fdt  qualitative  criteria, 
use  the  pairwise  comparison  method  aa  in  Weight  Categories  &  Criteria. 

Compute  Overall  Ratings 

AutoMan  coobinea  ratings  for  each  Investment  alternative  with 
criteria  weights  and  ranks  eltamatlvas  by  their  (..verall  ratings. 


Press  4—)  to  Select  Module  .  .  . 


ExhibK  2.  Help  Screen  Explaining  the  AutoMan  Menu. 

3.1  Select  or  Build  a  Model 

There  are  two  ways  to  make  a  selection  from  the  AutoMan  Menu; 

»  Move  the  highlighted  bar  to  the  desired  option  and  press  4-> ;  or 
0  Type  the  initial  letter  of  the  option. 

To  choose  Select  or  Build  a  Model: 

«  Press  4-1  (since  the  first  option  is  already  highlighted). 

This  option  displays  a  list  of  sample  models  included  with  AutoMan,  along  with  a  brief 
description,  the  date  created,  and  the  number  of  evaluation  criteria  in  each  (Exhibit  3).  The 
two  top  models,  SMALL  and  LARGE,  are  sample  models  to  illustrate  the  general  pattern  by 
which  models  may  be  structured.  They  contain  no  data  on  the  weights  or  ratings.  The  third 
sample  model,  EXAMPLE,  has  both  a  structure  and  hypothetical  data  on  the  weights  and 
ratings.  Press  the  FI  key  for  a  brief  description  of  the  options  listed  at  the  bottom  of  the 
screen. 

To  view  the  structure  of  any  model: 
o  Move  the  highlighted  bar  to  the  model. 

0  Press  F3. 

0  Press  Esc  to  return  to  the  Model  Selection  and  Building  screen. 

The  EXAMPLE  model  has  the  same  structure  as  the  model  you  are  about  to  build,  but  all  the 
data  have  already  been  entered.  If  you  do  not  want  to  practice  building  a  model  and  entering 
data  in  the  Tutorial,  you  may  select  EXAMPLE  and  go  directly  to  Section  3.2,  Weight 
Categories  and  Criteria,  and  review  each  .'itep  in  the  process  wth  a  complete  set  of  data 
already  entered.  To  select  EXAMPLE,  use  1  to  highlight  it  and  press  4-J . 
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Modal  Salaotlon  and  Building 

Modal  Salaotad:  NONE 

NAME 

DESCRIPTOR 

DATE 

CRITERIA 

SMALL 

Two  Catagorlaa 

03/E3/B1 

3 

LARGE 

Four  Catagorlaa 

03/2S/ai 

16 

EXAMPLE 

Fraottoa  Modal  with  TUTORIAL  Data 

03/23/91 

9 

Ui«  i  t  t 

^0  highlight  Modal  and  praaa:  FI  for  Balp  Eac 

!  to  Exit 

to  Saloot  F3  to  Edit  F4  to  Build  FS  to  Copy  DaJ 

1  to  Dalata 

Exhibit  3.  List  of  thA  Decision  Modeit. 


To  build  a  new  model: 

o  Press  the  F4  key  at  the  Model  Selection  and  Building  screen.  AutoMan  then  asks  for 
three  entries  at  the  bottom  of  the  screen  (Exhibit  4). 

«  A  new  model  will  be  built  from  scratch  so  you  do  not  want  to  pattern  the  model  after 
the  template  model.  Hold  the  Ctrl  key  down  and  press  Y  to  delete  everything  to  the 
right  of  the  cursor,  erasing  the  default  name  of  the  template  model. 

(If  you  do  not  erase  the  name  of  the  template  model,  then  the  categories,  criteria,  and 
alternatives  of  the  template  model  will  appear  on  the  screen  for  building  the  new  model. 
You  may  then  add,  delete,  or  edit  any  of  these  model  elements.) 

0  Press  4-1 . 

*  Type  the  new  model  name,  TUTORIAL. 

”  Type  its  descriptor.  Practice  Model,  and  press  4-<. 


NAME 

Modal  Selection  and  Building 
Modal  Salaotad;  HONE 

DESCRIPTOR 

DATE 

CRITERIA 

SMALL 

Two  Catagorlaa 

03/23/91 

5 

LARGE 

Four  Catagorlaa 

03/25/91 

16 

EXAMPLE 

Practlea  Modal  with 

TUTORIAL  Date 

03/25/91 

9 

1  Tamplata  Modal ;  SMALL 

New  Modal: 

1  Daacriptor: 

Esc  to  Csncoi  | 

Exhibit  4.  Building  a  Model:  Entw  Name  and  Descriptor. 
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You  must  now  specify  the  structure  of  the  new  model,  TUTORIAL.  TUTORIAL  will  have  three 
impact  categories:  Monetary,  Performance  Measures,  and  Strategic.  See  the  Glossary  for 
further  definition  of  the  categories,  their  criteria,  and  abbreviations  of  the  categories  and 
criteria.  Press  FI  for  help  in  building  a  model.  To  move  within  an  element  use  and  •—  , 
and  to  move  between  elements  use  |  and  i. 

To  enter  these  category  labels: 

0  Type  Monetary,  PerfMeaa,  and  StrateflC,  the  abbreviated  forms  of  the  category  labels  to 
fit  the  eight  character  limit  for  labels  in  AutoMan  (Exhibit  5). 
e  After  checking  that  the  category  labels  are  all  correct,  press  PgDn  to  leave  the  four 
remaining  category  entries  blank. 

(Be  sure  to  enter  all  categories  in  succession  from  left  to  right;  any  categories  entered 
beyond  a  blank  entry  will  be  ignored.) 


Exhibit  5.  Building  a  Model:  Enter  Categories. 


For  each  category,  you  may  enter  up  to  seven  evaluation  criteria.  Exhibit  6  depicts  the 
screen  once  all  criteria  are  entered.  One  criterion  for  the  Monetary  category  is  Initial  Cost 
of  the  investment  alternative,  which  may  include  currently  needed  repairs  of  an  existing 

system.  Another  Monetary  criterion  is  Revenue.  If  no  criteria  are  entered,  AutoMan 

automatically  adds  a  single  default  criterion  to  the  model,  using  the  same  label  as  the 

category  itself.  This  provides  a  way  to  have  a  category  that  serves  as  its  own  criterion. 

Enter  the  Monetary  criteria: 

o  Type  InitCost  and  Revenue  as  criteria  under  the  Monetary  category. 

0  Press  six  times  to  skip  through  the  five  remaining  undefined  criteria  (since  there 

are  only  two  criteria  for  this  category). 

The  next  category  to  specify  is  Performance  Measures,  abbreviated  as  PerfMeas.  It  includes 
non-monetary  measures  of  performance.  In  this  example  criteria  are:  Cycle  Time,  Schedule 
Attainment,  Throughput,  and  Yield. 


i 


Enter  Performance  Measures  criteria: 

•  Type  CyoloTIm,  Schedult,  Thruput,  and  Yiold,  the  abbreviated  forms  of  the  aiteria  labels. 
«  Press  four  times. 


1  BulXdina  •  N«h  Medal  I 

1  Modal:  TUTORIAl.  1 

1  Ent«r  at  laast  1  and  no 

nora  than  7  Catagoclaa  of  Evaluation  Criteria:  1 

Monatory 

PacfMaaa 

Stratago  1 

Entar  u|>  to  7 

Evaluation  Crltaria  for  aaoh  Catagory;  1 

1 .  InltCoat 

CyolaTln 

Plarlty 

2.  Ravanua 

Sehadula 

Quality 

3. 

Thtuput 

Rlak 

4. 

riald 

S. 

6. 

7. 

1  Entar  at  laaat  2  and  no 

nora  than  7  ALIERHATIVES  to  ba  evaluated; 

1  Exiatlns 

Haw 

1  PI  fox  Ralp  1  f  for  Naxt/Prior  Labal  PgDn  to  Sava  Eao  to  Canoal  | 

Exhibit  6.  Building  a  Model:  Entw  Criteria  and  Alternatives. 


The  last  category  is  abbreviated  Strategc  and  is  meant  to  include  the  evaluation  criteria 
often  associated  with  a  compan/s  strategic  plan.  For  the  model  TUTORIAL,  this  category 
consists  of  three  evaluation  criteria:  Flexibility,  Quality,  and  Risk. 

Enter  the  Strategic  criteria: 

•  Type  Flexity,  Quality,  and  Risk,  the  abbreviated  foims  of  the  criteria  labels. 

0  Press  five  times. 

Once  the  criteria  for  all  categories  have  been  entered,  you  must  enter  at  least  two  and  up  to 
seven  investment  alternatives.  These  alternatives  will  be  evaluated  with  respect  to  each 
criterion  entered  above.  The  TUTORIAL  model  has  two  investment  alternatives:  Existing  and 
New  (Exhibit  6).  Existing  is  the  current  system,  and  New  represents  a  specific  level  of 
investment  in  automated  manufacturing  equipment. 

Enter  the  alternatives: 

0  Type  Existing  and  New. 

0  Press  PgDn. 

Exhibit  7  displays  the  revised  list  of  decision  models  now  in  the  system.  Note  that 
TUTORIAL,  the  model  you  just  built,  has  been  added  at  the  bottom  of  this  list,  indicating  that 
the  TUTORIAL  model  has  been  saved.  Smcc  TUTORIAL  is  the  model  currently  selected  it  is 
shown  at  the  top  of  the  screen. 
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Mod*l  S*i*otion  and  Building 

Mod*l  S*l*ot«d;  TUTORIAL 

NAME 

DESCRIPTCR 

DATS 

CRITERU 

SMALL 

I>ra  Catagori** 

03/23/91 

3 

LARSE 

Four  Catagoria* 

03/23/91 

18 

Pxaetie*  Modal  with  TUTORIAL  Data 

03/23/91 

9 

TUTORIAL 

Fractic*  Modal 

03/28/91 

8 

1  Us*  1  I  to  highlight  Mod*l  snd  pr***:  FI  for  H*lp  E*o  to  Exit  1 

1  4-^  to  S*i*ot  F3  to  Edit  F4  to  Build  FS  to  Copy  D*1  to  D«l*t*  1 

Exhibit  7.  New  List  of  Decision  Models  Including  TUTORIAL. 


To  view  the  model  structure  (Exhibit  8); 

#  Highlight  the  TUTORIAL  model. 

“  Press  F3. 

**  Press  Esc  to  return  to  the  Model  Selection  and  Building  screen. 


1  Edit  Labala  of  Elerarchioal  Structure 

1  Model;  TUTORIAL 

1  Descriptor:  Practice  Hodal 

1  Categories  of  Evaluation  Criteria  I 

1  Monetary  PerfMeae 

Stratego  1 

1  Evaluation  Criteria  1 

InltCost  CycleTirn 

Flexity 

Ravanu*  Schedule 

Quality 

Thruput 

Risk 

Yield 

Altamatlves  to  be 

Evaluated 

*  Existing  New 

1  FI  for  Halp  i  f  for  Naxt/Frior  Label 

PgDn  to  Sava  Esc  to  Cancel 

Exhibit  8.  Structure  of  the  TUTORIAL  Model. 
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Now  you  could  modify  the  model.  By  pressing  F3  to  edit,  you  could  change  any  of  the  labels 
for  categories,  criteria,  and  alternatives,  but  not  the  structure  of  the  model.  By  pressing  FS 
to  copy,  you  c.ould  enter  a  new  set  of  alternatives  but  keep  the  structure  the  same.  By 
pressing  P4  to  build,  you  could  completely  modify'  the  structure  by  changing  the  number  of 
criteria,  categories,  and  alternatives.  With  F4  the  data  on  wei^ts  and  ratings  from  the 
original  model  are  no  longer  relevant  to  the  new  structure  and  so  are  not  transferred  to  the 
new  model.  Now  press  to  select  the  TUTORIAL  model  and  return  to  the  AutoMan  Menu. 

3.2  Weight  Categories  end  Criteria 

At  the  AutoMan  Menu,  type  W  to  select  Weight  Categories  and  Criteria. 

Press  the  FI  key  to  display  a  screen  of  instructions  describing  how  to  weight  categories. 
Categories  are  weighted  by  using  a  scale  of  0.100  to  9.900  to  indicate  how  many  times  as 
important  the  category  of  each  row  is  compared  with  the  category  of  each  column.  If  the 
two  are  equally  important,  enter  a  1.0.  If  the  row  category  is  MORE  important  than  the 
column  category,  enter  the  value  (greater  than  one)  comparing  row  to  column.  If  the  row 
category  is  LESS  important  than  the  column  category,  either  directly  enter  the  value 
(between  zero  and  one)  comparing  row  to  column,  or  enter  the  value  (greater  than  one) 
comparing  column  to  row  and  then  press  F2.  Pressing  F2  automatically  reverses  the 
comparison  by  inverting  the  value.  To  change  any  comparison  value,  use  the  7  and  i  keys  to 
move  to  the  desired  field  and  enter  the  correct  value. 

To  record  comparison  judgments  between  each  pair  of  the  three  categories  (Exhibit  9): 

"  The  Monetary  category  is  judged  £0  be  one  and  a  half  times  as  important  as  (or  50 
percent  more  important  than)  Performance  Measures,  so  type  the  value  1.5  in  the  first 
field  and  press  ^ . 

o  The  Strategic  category  is  judged  to  be  twice  as  important  as  Monetary.  But,  since  you 
are  asked  for  the  reverse  comparison: 

«  Type  the  value  2. 

«  Press  F2  while  still  in  the  second  field  to  reverse  the  order  of  the  comparison  and 
invert  the  value  to  0.500. 
o  Press  ♦-J . 


Exhibit  9.  Weighting  Categories:  Enter  Pairwise  Comparisons. 
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«  The  Strategic  category  is  judged  to  be  four  times  as  important  as  Performance 
Measures,  so  in  the  third  field: 

0  Type  the  value  4. 

«  Press  F2  to  reverse  the  comparison  and  invert  the  value  to  0.Z50. 
a  Press  or  PgDn  to  compute  the  category  weights  and  the  Inconsistency  Ratio. 

The  category  weights  displayed  in  Exhibit  10  represent  the  relative  importance  that  will  be 
assigned  to  each  category  in  determining  the  overall  ratings  of  the  alternatives.  The  weights 
are  derived  from  the  pairwise  comparisons  you  just  entered. 

Note  that  the  Inconsistency  Ratio  is  less  than  0.100,  so  there  is  no  need  to  redo  the 
comparisons.  For  an  explanation  of  the  Inconsistency  Ratio,  press  the  FI  key  now  to  display 
the  help  screen  or  refer  to  Section  2. 


Exhibit  10.  Weighting  Categories:  Computed  Weights  and  Inconsistency 
Ratio. 


o  Press  Esc  to  display  the  Selection  of  Category  for  Pairwise  Comparisons  screen. 

Once  the  categories  have  been  compared  with  each  other,  you  must  weight  the  criteria  within 
each  category.  The  procedure  for  comparing  criteria  is  the  same  as  that  for  comparing 
categories.  Comparisons  must  be  entered  for  the  criteria  in  each  of  the  three  categories 
listed  in  Exhibit  11.  Here  the  procedure  is  illustrated  in  detail  for  the  Performance  Measures 
category. 


Exhibit  11.  Weighting  Criteria:  Select  Category. 


To  compare  the  four  evaluation  criteria  in  the  Performance  Measures  category; 
o  Press  I  once  to  highlight  PerfMeas,  the  abbreviation  for  Performance  Measures, 
o  Press  to  display  the  Pairwise  Comparisons  between  Criteria  screen. 

Press  FI  to  sec  the  help  screen  on  comparing  criteria.  Since  there  are  four  Performance 
Measures  criteria,  a  total  of  6  (  =  4  x(4-l)  /  2)  pairwise  comparisons  arc  needed.  To  correct 
an  entry,  use  the  t  and  i  keys  to  move  to  the  desired  field  and  enter  the  correct  value. 

Enter  the  six  comparison  values  as  follows: 

o  Schedule  is  twice  as  important  as  CycleTim,  so  type  the  value  2  in  the  first  field  and 
then  press  F2  to  reverse  the  comparison.  Press  . 
o  CycleTim  is  twice  as  important  as  Thruput,  so  in  the  second  field  type  the  value  2  and 
press  . 

o  CycleTim  is  three  times  as  important  as  Yield,  so  in  the  third  field  type  the  value  3  and 
press  ■*-' . 

0  Schedule  is  twice  as  important  as  Thruput,  so  type  2  in  the  fourth  field  and  press  . 

0  Schedule  is  twice  as  important  as  Yield,  so  type  2  in  the  fifth  field  and  press  . 

0  Thruput  is  four  times  as  important  as  Yield,  so  type  4  in  the  last  field  and  press  4-^ . 

Exhibit  12  shows  the  screen  after  the  numbers  have  all  been  entered  and  the  weights  and 
Inconsistency  Ratio  have  been  computed.  The  Inconsistency  Ratio  is  greater  than  0.100,  so 
the  comparison  values  should  be  reviewed. 

There  is  a  convenient  method  to  force  consistency  by  using  the  comparison  values  in  the  first 
row  to  derive  the  perfectly  consistent  values  for  the  remaining  comparisons.  The  method 
assumes  the  user  has  the  most  confidence  in  the  first  row  comparisons.  The  consistent 
comparison  value  is  the  ratio  of  the  first  row  value  for  the  current  column  criterion  to  the 
first  row  value  for  the  current  row  criterion.  For  example,  the  consistent  value  for 
comparing  Schedule  to  Yield  would  be  6.000  (  =  3.000/0.500),  the  value  for  comparing 
CycleTim  to  Yield  divided  by  the  value  for  comparing  CycleTim  to  Schedule. 
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Racocdlng  Palrwlsa  CooipariaoRS  batwaan  Crltaria 
Modal;  TUTORIAL  Catagory:  ParfMaas 


CyclaTim 

Schedule 

Thruput 

Yield 

CycleTlm 

0.500 

2.000 

3.000 

Schedule 

2.000 

2.000 

Thruput 

4.000 

Yield 

CyclaTim 

Schedule 

Thruput 

Yield 

Weights  0.290 

0.378 

0.228 

0.104 

Inconalstancy  Ratio  0.109  (Excaeds  0.100.  Redo  Cotnpailsona  ) 


FI  for  Halp  ^  to  Rado  Eao  to  Exit 


Exhibit  12.  Weighting  Crtterla:  Pairwise  Comparisons  Cause  Excessive 
Inconsistency 


To  edit  the  comparison  values: 
o  Press  ■4-'  to  redo. 

o  Press  i  four  times  to  edit  the  field  comparing  Schedule  to  Yield  where  2.000  is  entered. 

0  Type  6  to  replace  the  value  2.000  and  press  PgDn  to  recompute  the  weights  and  the 
Inconsistency  Ratio.  The  Inconsistency  Ratio  b  now  much  lower  as  shown  in  Exhibit  13. 


Recording  Pairwise  Comparisons  between  Criteria 
Model;  TUTORIAL  Category;  ParfMaas 


CyclaTim 

Schedule 

Thruput 

Yield 

CycleTim 

O.SOO 

2.000 

3.000 

Schedule 

2.000 

6.000 

Thruput 

4.000 

Yield 

CycleTlm 

Schedule 

Thruput 

Yield 

Weights  0.274 

0.448 

0.208 

0.070 

Inconsistency  Ratio  0.036  [Less  than  0.100.  Comparisons  OK  1 


FI  for  Help  4—*  to  Rado  Esc  to  Exit 


Exhibit  13.  Weighting  Critaria;  Reviaad  Comparlaont  improve 
Inconsistency  Ratio. 
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Now  press  E#C  to  return  to  the  Selection  of  Category  for  Pairwise  Comparisons  screen.  At 
this  screen  (Exhibit  11),  the  Inconsistency  Ratios  for  the  categories  already  selected  can  be 
displayed.  You  can  also  review  the  share  of  the  overall  rating  controlled  by  each  category. 
Just  hold  down  the  Ctrl  key  and  press  End  (Ctrl-End)  to  see  the  Inconsistency  Ratios  and 
shares.  To  restore  the  screen  with  the  criteria  lists,  hold  down  the  Ctt'l  key  and  press  Home 
(Ctrl-Home). 

To  compare  the  importance  of  the  two  evaluation  criteria  m  the  Monetary  category; 
o  Highlight  the  Monetary  category. 

0  Press  . 

0  Type  3  to  indicate  that  InitCost  is  three  times  as  important  as  Revenue. 

0  Press  or  PgDn  to  compute  the  weights  and  the  Inconsistency  Ratio. 

0  Press  Esc  to  return  to  the  Selection  of  Category  screen. 

To  compare  the  importance  of  the  three  evaluation  criteria  m  the  Strategic  category: 
o  Highlight  the  Strategic  category. 

<■  Press  . 

0  Type  the  first  two  comparison  values  pressing  4-i  after  each  one:  1.5  and  1. 
o  For  the  third  field  type  1.5  then  F2  to  reverse  the  comparison  and  invert  the  value  to 
0.667. 

«  Press  or  PgDn  to  compute  the  weights  and  the  Inconsistency  Ratio, 
o  Press  Esc  to  return  to  the  Selection  of  Category  screen. 

0  Press  Esc  to  return  to  the  AutoMan  Menu. 


3.3  Rate  Alternatives 

The  third  step  in  AutoMan  is  to  rate  investment  alternatives  with  respect  to  each  criterion. 

«  Type  R  to  select  the  Rate  Alternatives  option  from  the  AutoMan  Menu  and  display  the 
Selection  of  Rating  Criterion  screen  (Exhibit  14). 


1  Salsctlon  of  Rating  Critarion  I 

1  Modal ;  TUTORIAL  1 

CRITERION 

CURRENT  RATINGS 

Existing  New 

InltCont 

Ravanua 

CyclaTim 

Sohadula 

Thiruput 

Ylald 

Flaxlty 

Quality 

Rlak 

Use  i  1  to  highlight  Criterion  end  press: 

4—*  for  PairMlse  Comparisons  0  for  Fsrfoxmanco  Data 

Ctrl-'End  to  View  Shares  Ctrl-Homa  to  View  Ratings 

FI  for  Halp 

Esc  to  Exit 

Exhibit  14.  Rating  Alternatives:  Select  Criterion. 
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At  this  step,  each  alternative  is  rated  with  respect  to  the  nine  criteria  in  the  TUTORIAL 
model.  Either  of  the  two  rating  methods  may  be  used;  pairwise  comparison  or  performance 
data.  The  pairwise  comparison  method  is  the  same  as  that  used  in  Step  2  for  weighting 
categories  and  criteria.  The  performance  data  method  requires  actual  data  on  the  performance 
of  each  alternative  with  respect  to  the  criterion.  Press  FI  for  help  on  deciding  which  rating 
method  is  appropriate  to  a  given  criterion. 

Note  that  the  performance  data  used  for  a  criterion  should  be  either  directly  or  inversely 
proportional  to  the  desirability  of  alternatives.  Consequently,  negative  or  zero  values  cannot 
be  used  for  performance  data.  In  such  cases,  the  pair^e  comparison  method  should  be  used 
for  rating  alternatives  with  respect  to  that  criterion.  Note  also  that  all  of  the  performance 
data  for  a  given  criterion  must  be  entered  in  the  same  units.  For  example,  use  thousands  of 
dollars  valued  at  1989  price  levels.  Similarly,  if  cash  flows  occur  at  different  times,  use 
discounting  to  convert  all  values  for  that  criterion  to  the  same  time  period. 

Use  1  and  t  to  highlight  the  criterion  to  be  rated.  You  can  also  use  the  PgDn  and  PgUp 
keys  to  move  to  the  bottom  and  top  of  the  list  of  criteria. 

To  enter  performance  data  for  Revenue: 

^  Press  1  once  to  highlight  Revenue. 

o  Press  D  to  enter  performance  data  on  the  Revenue  expected  from  the  Existing  and  New 
alternatives. 

o  Type  900  for  Existing  and  1200  for  New,  pressing  ■•-i  after  each  (Exhibit  15).  Ignore 
commas  that  appear  as  you  begin  to  enter  data.  Once  you  press  commas  will 
automatically  align  based  on  the  size  of  the  number. 

These  two  entries  assume  the  Existing  system  results  in  $900,000/year  in  Revenue  and  the 
New  system  results  in  $1.2  million/year.  The  units  in  which  the  data  are  entered  must 
be  the  same  for  all  alternatives  within  the  criterion  being  evaluated. 

0  Press  Y  for  Yes  at  the  question:  "Are  HIGHER  Performance  Values  BETTER?" 

Answering  Yes  indicates  that  you  prefer  more  rather  than  less  Revenue. 


Rating  Aitematlvea  by  Ferformanca  Data 
Modal;  TUTORIAL  Critarlon;  Ravaiiua 


ALTERNATIVE  PERFORMANCE  RATING 


Exiatlng  900 

Naw  1,200 


Ara  HIGHER  Farformanc*  Valuas  BETTER  [Y/N]?  Y 


FI  for  Htlp  PgDn  to  Coinputa  Ratings  Esc  to  Cancsl 


Exhibit  IS.  Rating  Aitamativet:  Enter  Performance  Data. 
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The  Revenue  ratings  for  the  Existing  and  New  systems  will  then  appear  to  the  right  of  the 
performance  data  (Exhibit  16).  Note  that  New,  with  higher  revenue,  is  given  a  proportionally 
higher  rating  for  this  criterion  because  higher  values  are  better. 


Rating  Alternatives  by  Performance  Data 
Modal;  TUTORIAL  Criterion:  Revenue 


ALTERNATIVE  PERFORMANCE  RATING 


Existing  900  0.429 

New  1,200  0.S71 


Are  HIGHER  Performance  Values  BETTER  [Y/Nl?  Y 


FI  for  Help  *  to  Redo  Esc  to  Exit 


Exhibit  16.  Rating  Aiternatives;  Computed  Ratings  for  Performance 
Data. 


To  enter  performance  data  for  Initial  Cost  (following  the  example  for  Revenue); 

o  Press  Esc  to  return  to  the  Selection  of  Rating  Criterion  screen  depicted  in  Exhibit  14, 
which  now  shows  the  ratings  just  computed  for  Revenue. 

®  Press  T  once  to  highlight  InitCost,  the  abbreviation  for  the  Initial  Cost  criterion. 

«  Press  D  to  enter  performance  data  on  the  initial  costs  of  the  Existing  and  New  systems. 

0  Type  200  for  Existing  and  600  for  New,  pressing  ♦-i  after  each. 

The  Existing  system  will  require  an  initial  outlay  of  $200,000  in  repair  costs  to  continue 
in  service,  and  the  New  system  has  an  estimated  initial  cost  of  $^,000.  If  the  initial 
cost  of  the  existing  system  were  absolutely  zero,  the  pairwise  comparison  method  should 
be  used  to  rate  the  alternatives  with  respect  to  initial  cost. 

o  Type  N  for  No  when  asked,  "Are  HIGHER  Performance  Values  BEITER?"  since  higher 
costs  are  not  better. 

o  Press  Esc  to  return  to  the  Selection  of  Rating  Criterion  screen  (Exhibit  14). 

The  InitCost  ratings  for  the  Existing  and  New  systems  now  appear,  with  a  higher  rating  for 
the  lower-cost  Existing  system. 

Use  the  pairwise  comparison  method  to  rate  alternatives  with  respect  to  evaluation  criteria  for 
which;  (1)  no  objective  performance  data  exists;  (2)  some  alternatives  have  zero  or  negative 
performance  values;  or  (3)  performance  is  measured  by  the  presence  or  absence  of  a  feature. 
The  method  is  similar  to  that  for  weighting  criteria.  Instead  of  judging  the  importance  of 
criteria,  however,  you  judge  the  performance  of  alternatives  with  respect  to  each  criterion. 
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To  judge  the  performance  of  alternatives  with  respect  to  Flexibility  (since  Flexibility  is  a 

criterion  for  which  objective  data  are  difficult  to  obtain): 
e  Highlight  Flexity. 

0  Press  4-1  to  display  the  Rating  Alternatives  by  Pairwise  Comparisons  screen  and  press  FI 

if  you  want  to  see  the  help  screen  on  comparing  alternatives. 

0  Type  the  value  3  then  press  F2  to  reverse  the  comparison,  indicating  that  the  New 

system  will  be  three  times  as  flexible  as  the  Existing  system. 

Since  our  example  is  evaluating  just  two  cltematives,  you  only  need  to  make  one 
comparison. 

»  Press  PgDn  to  compute  the  Flexibility  ratings  (E4xhibit  17). 

Because  there  is  no  room  for  any  inconsistency  in  judgment  when  comparing  only  two 
items,  the  Inconsistency  Ratio  is  a  perfect  score  of  0.000. 

"  Press  Esc  to  return  to  the  Selection  of  Rating  Criterion  screen. 


Rating  Altarnatlvaa  by  Paltiflsa  Comparisons 
Model:  TUTORIAL  Criterion;  Flsxlty 


Existing  New 
Existing  0.333 

Nsh 

Existing  New 
Ratings  0.230  0.7S0 

Inconsistency  Ratio  0.000  (Loss  than  0.100.  Comparisons  OK  ] 


FI  for  Help  4—^  to  Redo  Esc  to  Exit 


Exhibit  17.  Rating  Aiternatives;  Computed  Ratings  for  Pairwise 
Comparisons. 


You  must  enter  performance  data  or  make  pairwise  comparisons  for  each  of  the  criteria  listed 
on  this  screen  or  the  computed  overall  ratings  will  be  incomplete  and  inaccurate.  To  complete 
the  rating  process  for  the  remaining  criteria  enter  the  rest  of  the  pairwise  comparison  data 
following  the  procedure  illustrated  fur  Flexity.  Highlight  the  criterion,  press  •»-'  to  select  it, 
and  enter  the  following  data  for  each  criterion  in  turn: 


CvdeTim  Schedule  Thruput _ _  Yield _ Quality _ Risk 

2  then  F2  .75  3  then  F2  2  then  F2  2  then  F2  2 
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Exhibit  18  shows  the  saeen  after  all  ratings  have  been  completed. 


¥ 


0  Press  Esc  to  return  to  the  AutoMan  Menu. 


Salaotlon  of  Rating  Crltarlon 
Modal-  mORIAI. 


CURRENT  RATINOS 


CRITERION  Existing  Now 


InltCoat 

0.7S0 

0.230 

Rtvanua 

0.<^29 

0.371 

CycliTlm 

0.333 

0.667 

Sehadula 

0.^29 

0.371 

Thruput 

0.230 

0.730 

Ylald 

0.333 

0.667 

Flaxlty 

0.230 

0.730 

Quality 

0.333 

0.667 

Rlak 

0.867 

0.333 

Uaa  i  t  to  highlight  Crltarlon  and  xraas; 

for  Pairwlsa  Coopariaons  D  for  Farfonnanoa  Data  FI  for  Balp 

Ctrl-End  to  Viaw  Sharas  Ctrl-Hona  to  Vlaw  Ratings  Eao  to  Exit 


Exhibit  18.  Rating  Aiternstives:  Ustof  All  Ratings. 


3.4  Compute  Overall  Ratings 

After  the  criteria  have  been  weighted  and  the  alternatives  have  been  rated  against  all  of  the 
evaluation  criteria,  the  Overall  Ratings  may  be  computed  by  AutoMan. 

To  compute  the  Overall  Ratings: 
o  Press  C  at  the  AutoMan  Menu. 

To  produce  the  Overall  Rating  for  each  alternative,  AutoMan  combines  the  weights  derived 
from  comparing  the  criteria  with  the  ratings  of  the  alternative  with  respect  to  each  criterion. 
The  Overall  Rating  equals  the  sum  of  the  products  of  the  criteria  shares  times  the  criteria 
ratings.  The  results  appear  In  a  bar  chart  as  shown  in  Exhibit  19.  The  alternatives  are 
ranked  in  the  order  of  their  overall  ratings.  For  each  alternative,  the  overall  rating  is 
displayed  beside  a  horizontal  bar  proportional  to  the  rating.  Press  FI  to  see  the  help  screen 
explaining  how  the  overall  ratings  are  computed  and  describing  the  two  types  of  printed 
reports  available. 

The  Summary  Report  includes: 

Table  1.  Ranking  of  Alternatives  by  Overall  Rating 

Table  2.  Model  Structure,  Weights,  Shares,  and  Inconsistency  Ratios 

Table  3.  Ratings  by  Criterion  and  Overall  Ratings  of  Alternatives 

The  Complete  Report  includes  all  tables  of  the  Summary  Report  plus: 

Table  4.  Pairwise  Comparison  Data  for  Weighting  Categories  and  Criteria 
and  for  Rating  Alternatives 
Table  5.  Performance  Data  for  Rating  Alternatives 


Exhibit  1 9.  Overall  Ratings  of  the  Aitamatives. 


The  Complete  Report  for  the  completed  'rUTORlAL  model  is  shown  m  Exhibit  20. 


3.5  Conduct  Sanaitivity  Analysis 

If  you  have  a  graphical  monitor,  press  S  to  select  the  Sensitivity  Analysis  option.  Then 
move  the  light  bar  to  any  criterion  and  press  to  display  the  sensitivity  analysis  plots  for 
all  the  alternatives.  The  horizontal  axis  gives  the  percentage  share  of  importance  (weight)  of 
the  criterion  being  analyzed.  The  vertical  axis  gives  the  Overall  Ratings  of  the  alternatives. 
For  reference,  the  current  percentage  share  is  marked  with  a  vertical  line.  In  this  one  graph 
you  can  see  the  Overall  Ratings  of  every  alternative  for  every  possible  percentage  share 
assigned  to  the  criterion  of  interest.  The  points  where  the  lines  intersect  the  left  axis  (the 
share  is  zeio)  indicate  how  alternatives  would  be  rated  if  this  criterion  were  totally  ignored 
and  all  weight  formerly  attributed  to  it  were  redistributed  proportionately  to  the  remaining 
criteria.  The  points  where  the  lines  intersect  the  right  axis  (the  share  is  100  percent) 
indicate  how  alternatives  would  be  rated  if  this  were  the  only  criterion  that  mattered  and  all 
other  criteria  were  ignored.  Breakeven  points  occur  where  the  plots  of  two  alternatives 
intersect.  The  rankings  of  the  two  alternatives  reverse  when  the  criterion  share  moves  from 
one  side  of  a  breakeven  point  to  the  other.  Press  P  to  print  the  graph.  Instructions  for 
setting  up  your  printer  for  graphical  printing  are  in  Section  2.S. 

0  Press  Esc  to  return  to  the  AutoMan  Menu. 

If  you  did  not  enter  a  complete  set  of  data  during  the  Tutorial,  you  may  choose  Select  or 
BuUd  a  Model  from  the  AutoMan  Menu  to  return  to  the  list  of  models  and  then  select  the 
model  called  EXAMi'^LE,  which  contains  a  complete  data  set  for  the  Tutorial. 

This  concludes  the  Tutorial.  If  you  want  more  practice  with  AutoMan,  use  the  F5  option 
under  Select  or  Build  a  Model  to  add  alternatives  to  your  TUTORIAL  model  and  then  redo  the 
ratings  following  the  illustrations  in  Section  3.3.  You  could  also  select  either  the  SMALL  or 
LARGE  models  and  enter  both  weighting  and  rating  data  into  them.  Finally,  you  could  press 
the  F4  key  to  btnid  a  new  model  of  your  own  using  the  Glossary  of  Evaluation  Criteria. 

When  you  are  finished  practicing  with  AutoMan,  press  Q  at  the  AutoMan  Menu  to  quit  and 
safely  close  the  files  containing  your  models. 
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Exhibit  20.  Complote  Report  for  the  TUTORIAL  Model. 

Model:  TUTORIAL--Practlce  Model  03/28/91  Pg  1 

Table  1.  Ranking  of  Alternatives  by  Overall  Rating 


RANK  ALTERNATIVE  RATING 

->i  New  0.521  lllilllllllllllllllMIMIIMIIIMIIIIIIillilllllll 


2  Existing  0.480  | | | | | | I | | | | | j | | | I | |  |  |  |  |  |  |  |  |  |  |  |  |  i  I  |  |  |  |  |  |  |  |  |  |  |  |  | 
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Exhibit  20.  Complft*  Report  for  the  TUTORIAL  Model,  cont. 


Model:  TUTORIAL--Practice  Model  03/28/91  Pg  2 

Table  2.  Model  Structure,  Weights,  Shares,  and  Inconsistency  Ratios 

RATING 


CATEGORY 

1  CRITERION 

WEIGHT 

SHARE 

INCONSISTENCY 

MONETARY 

InitCost 

0.750 

0.197 

0.000 

Weight  -  0.263 
Inconsistency  “  0.000 

1  Revenue 

1 

1 

0.250 

0.066 

0.000 

PEREME/iS 

C/cleTim 

0.274 

0.044 

0.000 

1  Schedule 

0.448 

0.071 

0,000 

Weight  ••  0.159 

1  Thruput 

0.208 

0.033 

0.000 

Inconsistency  0.036 

1  Yield 

C.070 

0.011 

0.000 

STRATEGC 

Flexity 

0.375 

0.217 

0.000 

1  Quality 

0.250 

0.145 

0.000 

Weight  ”  0.578 
Inconsistency  ■  0,000 

1  Risk 

1 

1 

1 

0.375 

0.217 

0.000 

[Inconsiscency  of  pairwise  comparisons  between  categories  -  0.008] 


^Pairwise  comparisons  with  inconsistency  values  >  0.1  should  be  redone. 
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Exhibit  20.  Complote  Report  for  the  TUTORIAL  Modal,  cont. 


Model;  TUTORIAL- -Practice  Model  03/28/91 

Table  3.  Ratings  by  Criterion  and  Overall  Ratings  of  Alternatives 

CATEGORY;  RATINGS 

CRITERION  Existing  New 


1: 

InitCost 

0.750 

0.250 

1: 

Revenue 

0.429 

0.571 

2: 

CycleTim 

0.333 

0.667 

2; 

Schedule 

0.429 

0.571 

2: 

Thruput 

0.250 

0.750 

2; 

Yield 

0.333 

0.667 

3; 

Flexity 

0.250 

0.750 

3: 

Quality 

0.333 

0.667 

3: 

Risk 

0.667 

0.333 

OVERALL 

RATING 

0.480 

0.521 

Pg  3 
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Exhibit  SO.  Complot*  Report  for  the  TUTORIAL  Model,  eont. 


Model*  TUTORIAL--Practice  Model 


03/28/91 


Table  4.  Pairwise  Comparison  Data  for  Weighting  Categories  and  Criteria 
and  for  Rating  Alternatives 


Monetary 

PerfMeas 

Strategc 


Comparisons  between  Categories 
Monetary  PerfMeas  Strategc 
1.500  0.500 

0.250 


InitCost 

Revenue 


Comparisons  between  Criteria  within  Category:  Monetary 
InitCost  Revenue 
3.000 


CycleTim 

Schedule 

Thruput 

Yield 


Comparisons  between  Criteria  within  Category:  PerfMeas 

CycleTim  Schedule  Thruput  Yield 

0.500  2.000  3.000 

2.000  6.000 

4.000 


Flexity 

Quality 

Risk 


Comparisons  between  Criteria  within  Category:  Strategc 
Flexity  Quality  Risk 
1.500  1.000 

0.667 


Comparisons  between  Alternatives  rated  by  Criterion:  InitCost 


Existing 

New 


[See  Table  5  for  Performance  Data] 

Comparisons  between  Alternatives  rated  by  Criterion:  Revenue 
[See  Table  5  for  Performance  Data] 

Comparisons  between  Alternatives  rated  by  Criterion:  CycleTim 
Existing  New 
0.500 


Existing 

New 


Comparisons  between  Alternatives  rated  by  Criterion:  Schedule 
Existing  New 

0.750 


Existing 

New 


Comparlscns  between  Alternatives  rated  by  Criterion:  Thruput 
Existing  New 
0.333 


Exhibit  20.  Complete  Report  for  the  TUTORIAL  Model,  cont. 


Model;  TUTORIAL- -Practice  Model 


03/28/91  Pg  5 


Table  4.  Pairwise  Comparison  Data  for  Weighting  Categories  and  Criteria 
and  for  Rating  Alternatives 

Comparisons  between  Alternatives  rated  by  Criterion:  Yield 
Existing  New 
Existing  0.500 

New 

Comparisons  between  Alternatives  rated  by  Criterion:  Flexity 
Existing  New 
Existing  0.333 

New 

Comparisons  between  Alternatives  rated  by  Criterion:  Quality 
Existing  New 
Existing  0.500 

New 


Comparisons  between  Alternatives  rated  by  Criterion:  Risk 
Existing  New 
Existing  2.000 

New 
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Exhibit  20.  Complet«  Report  for  the  TUTORIAL  Model*  com. 


Model:  TUTORIAL--Practlce  Model  03/28/91  Pg  5 

Table  4.  Pairwise  Comparison  Data  for  Weighting  Categories  and  Criteria 
and  for  Rating  Alternatives 

Comparisons  between  Alternatives  rated  by  Criterion:  Yield 
Existing  New 
Existing  0.500 

New 

Comparisons  between  Alternatives  rated  by  Criterion:  Flexity 
Existing  New 
Existing  0.333 

New 

Comparisons  between  Alternatives  rated  by  Criterion:  Quality 
Existing  New 
Existing  0.500 

New 

Comparisons  between  Alternatives  rated  by  Criterion:  Risk 
Existing  New 
Existing  2.000 

New 


-  28  - 


GLOSSARY  OF  EVALUATION  CRITERIA 


This  glossary  defines  criteria  for  evaluating  automated  manufacturing  investments  that  are 
used  in  the  sample  models  of  AutoMan.  Other  criteria  may  be  relevant  to  manufacturing 
mvestment  decisions,  since  such  investments  may  have  many  diverse  impacts.  The  particular 
mix  of  impacts  pertinent  to  each  organization,  however,  depends  upon  the  intensity  of 
automation  and  the  organization’s  priorities.  The  intensity  of  automation  affects  the 
magnitude  of  an  impact  and  whether  the  impact  is  significant  enough  to  be  included  in  the 
analysis.  For  example,  at  relatively  low  levels  of  automation,  improved  flexibility  may  not  be 
possible  because  the  rest  of  the  factory  will  retain  its  specialized,  dedicated  equipment.  In 
this  environment,  flexibility  is  unaffected  and,  therefore,  not  needed  as  a  criterion. 

An  organization’s  priorities  also  determine  whether  an  impact  is  important  enough  to  warrant 
inclusion.  Priorities  vary  by  industry  and  competitive  strategies.  Even  a  large  impact  may 
not  be  relevant  to  an  organization  or  a  particular  decision.  For  example,  capacity  utilization 
rates  may  significantly  decrease  with  increased  automation,  but  management  may  not  wish  to 
include  this  impact  as  a  distinct  evaluation  criterion.  A  higher  rate  of  capacity  utilization 
may  not  be  a  desirable  goal  because  it  may  lead  to  excess  mventory;  its  effects  may  best  be 
included  as  part  of  an  inventory  criterion. 

The  particular  categories  (groups  of  criteria)  and  criteria  used  in  AutoMan’s  sample  models  are 
defined  for  illustrative  purposes.  The  full  name  of  each  is  given,  followed  by  its  abbreviated 
form  to  fit  the  eight  character  limit  for  labels  in  AutoMan.  Categories  are  bold>faC9d  and 
criteria  are  underlined.  Some  criteria,  such  as  quality  and  ris?,  are  often  important  to 
investment  decisions,  yet  they  involve  complex  issues  that  have  not  yet  been  resolved.  The 
interpretation  of  such  criteria  may  va-.7  among  organizations. 

Refer  to  this  glossary  for  criteria  to  consider  when  building  a  new  model  and  revise  and  add 
to  the  definitions  to  meet  the  needs  of  your  organization.  In  this  way,  a  custom-made 
glossary  can  be  developed  to  promote  consistency  m  meaning  among  multiple  users  within  the 
same  organization. 


Monetary  Category  (Monetary) 

Evaluation  criteria  that  can  either  be  directly  measured  in  doUars  or  derived  from  doUar- 
deuominated  data  (e.g.,  financial  ratios).  Includes  traditional  measures  of  finaircial  worth,  ail 
of  which  are  derived  from  essentially  the  same  data.  Be  aware  of  possible  double  countmg  if 
several  of  these  measures  are  included  in  a  model.  This  category  may  be  further  subdivided 
into  a  Bonefitt  Category  (Benefit),  composed  of  criteria  for  which  higher  values  are  better, 
and  a  Cocte  Category  (Coat),  composed  of  criteria  for  which  lower  values  are  better. 


Benefit-to-Cost  Ratio  (BCRI:  Monetary  benefits  divided  by  costs,  where  both  are  discounted 
to  a  present  value  or  equivalent  uniform  annual  value  (American  Society  for  Testing  and 
Materials,  1989). 
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Initial  Cost  f'lnitCost'):  The  sum  of  design,  purchase,  installation,  Imancing,  and  transition 
costs  necessary  to  make  new  automated  manufacturing  equipment  ready  for  use.  For 
existing  equipment,  any  immediate  repair  or  replacement  costs  necessary  to  keep  it  in 
operation. 

Intenial  Rate  of  Return  flRRl:  The  compound  rate  of  interest  that  equates  the  stream  of 
dollar  benefits  or  savings  to  dollar  costs  over  some  defined  study  period.  When  the 
retiun  is  measured  solely  on  the  origimd  investment  (which  implicitly  suggests  the  same 
return  on  reinvestments  as  on  the  origmal  investment),  this  measure  is  known  as  the 
unadjusted  internal  rate  of  return.  When  a  combined  return  on  the  original  investment 
and  reinvested  earnings  is  measured,  it  is  known  as  the  adjusted  internal  rate  of  return 
(American  Society  for  Testing  and  Materials,  1989,  pp.  1114, 1119).. 

Inventory  Cost  flnventrvl:  The  sum  of  (1)  the  cost  of  ordering  purchased  parts  for  raw 
materials  inventory,  or  the  cost  of  machine  setup  for  finished  goods  inventory,  plus  (2) 
inventory  carrying  costs.  If  there  is  a  stockout  problem,  other  factors  to  be  considered 
are  stockout  cost  per  unit,  demand  during  lead  time,  and  the  economic  ordering  quantity 
(Jordan,  1987,  pp.  185-190).  With  automated  manufacturing,  combined  operations,  together 
with  reductions  in  non-productive  times,  may  reduce  work-in-process  inventory  levels. 
Finished  goods  inventories  may  also  be  reduced  as  a  result  of  smaller  lot  sizes  and 
shorter  cycle  times. 

Life-Cvcle  Cost  CLCO:  The  sum,  over  some  defined  study  period,  of  costs  of  initial 
investment  (less  resale  value),  replacements,  operations  (including  energy  use),  and 
maintenance  and  repair  of  an  investment.  This  measure  is  expressed  in  present  or  annual 
value  terms  (American  Society  for  Testing  and  Materials,  1989). 

Net  Benefits  fNB'i:  The  difference  between  the  monetary  benefits  and  costs-where  both  are 
discounted  to  present  or  annual  value  dollars  (American  Society  for  Testing  and 
Materials,  1989). 

Payback  Period  CPayback):  The  time  required  for  the  cumulative  benefits  from  an  investment 
to  pay  back  the  investment  cost  and  other  accrued  costs.  When  the  time  value  of  money 
is  not  considered,  this  measure  is  known  as  the  simple  payback  period;  when  the  time 
value  of  money  is  considered,  it  is  known  as  the  discount^  payback  period  (American 
Society  for  Testing  and  Materials,  1989). 

Project  Cash  Flow  fCashPlowl:  The  stream  of  monetary  values-costs  and  benefits-resulting 
from  a  project  investment  (American  Society  for  Testing  and  Materials,  1989). 

Revenue  f  Revenue*) :  Total  dollar  sales  volume  per  time  period. 

Rework  Losses  (Rework'i:  The  cost  of  correcting  defective  work.  Rework  losses  are  also  the 
cost  of  work  performed  to  correct  service-revealed  difficulties  when  the  work  is 
performed  before  the  part  is  delivered  to  the  customer  (Jordan,  1987,  p.  130). 

Scrap  Losses  fScrao):  The  cost  of  any  component  which,  due  to  defective  work  on  the  part 
of  the  machine  operator,  damage  m  handling,  or  other  causes,  makes  the  part  unfit  for 
use  in  the  end  product.  Included  also  is  the  cost  of  parts  that  are  made  to 
predetermined  specffications  but  that  are  scrapped  due  to  service-revealed  problems  that 
cannot  be  corrected  through  rework  (Jordan,  1987,  p.  130). 
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Performance  Meaeuree  Category  (PerfMeae) 


k- 


Evaluation  criteria  that  can  be  measured,  but  not  easily  converted  to  dollars.  Includes  non¬ 
monetary  measures  of  business  and  plant  effectiveness  in  relation  to  the  goals  and  objectives 
developed  in  the  strategic  planning  process  (Computer  Aided  Manufacturing-International,  Inc., 
1988,  p.  159). 


Capacitv  Utilization  Rate  fCanUsel:  The  ratio  of  actual  output  to  full-capacity  output 
(Baimock  et  al..  1972,  p.  55). 

Customer  Lead  Time  fCustLeadl:  The  final  phase  in  the  production  cycle  is  the  delivery  of 
the  product  to  the  customer.  Customer  Lead  Time  is  the  amount  of  time  between  the 
receipt  of  an  order  and  actual  product  delivery. 

Cycle  Time  (CvcleTim):  The  time  between  arrival  at  the  factory  of  material  for  a  product  and 
shipping  of  the  product  (CAM-I,  1938,  p.  239).  Cycle  time  is  dependent  upon:  (1)  the 
number  of  machines  through  which  a  part  is  routed,  (2)  machine  setup  time,  (3)  batch 
size,  (4)  operation  time  (machine  time,  and  workpart  and  tool  handling  times),  and  (5) 
non-operation  time  (transportation,  delays,  and  inspections)  (Salomon  and  Biegel,  1984,  p. 
89).  Increased  automation  may  affect  all  five  of  these  components  of  cycle  time. 

Productivity  fProdtiwi:  The  comparison  of  the  output  of  a  production  process  or  an 
enterprise  with  the  corresponding  inputs  (e.g.,  labor,  materials,  capital)  required  to 
generate  that  output.  Productivity  measures  are  formulated  as  a  ratio  of  output  to  one 
or  more  of  the  inputs  (Weber  and  Lippiatt,  1983,  p.  1). 

Schedule  Attainment  (Schedule) :  The  percentage  of  acceptable  output  to  total  scheduled 
output  at  the  scheduled  due  date.  Automation  may  improve  schedule  attainment  by 
increasing  the  level  of  operational  control  and  by  allowing  more  accurate  produaion 
forecasts  derived  from  an  integrated  data  base. 

Setup  Time  (Setunl:  The  time  req»jired  to  prepare  a  machine  or  work  center  for  a 
manufacturing  process  (CAM-I,  1988,  p.  244).  Automation  permits  shorter  setup  limes 
because,  any  process  that  has  been  set  up  once,  can  be  set  up  quickly  again  by 
reprogramming,  compared  with  the  retooling  required  in  traditional  mani^acturing  (Rhea, 
1984,  p.  50). 

Throughput  fThruput’):  The  amount  of  raw  material  processed  within  a  given  time  period 
(Random  House,  Inc.,  1973,  p.  1370).  Since  automation  is  designed  to  improve  material 
flow,  it  is  likely  to  improve  throughput  of  individual  processes.  When  measuring  the 
impact  of  automation  on  product  throughput,  however,  total  factory  throughput  is  most 
important.  An  improvement  in  the  modified  area  is  offset  somewhat  by  bottlenecks  in 
others. 

Vendor  Lead  Time  fVendLead):  The  first  phase  in  the  production  cycle  is  the  request  for  and 
delivery  of  parts.  Vendor  Lead  Time  is  the  amount  of  time  between  the  request  for 
delivery  of  parts  and  their  arrival  (CAM-I,  1988,  p.  241). 

Yield  (Yieldl:  Actual  output,  expressed  as  the  percentage  of  what  is  theoretically  possible. 
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Strategic  Category  (Strategc) 


Evaluation  criteria  that  cannot  easily  be  measured.  Includes  issues  often  associated  with  goals 
and  objectives  outlined  in  the  long-term  or  strategc  planning  process. 


Flexibility  (Flexitv'i:  The  ability  to  respond  effectively  to  cbang^  circumstances  (Zelenovic, 

1982).  Flexibility  is  a  strategy  used  to  deal  with  uncertainties  both  in  the  market  and  in 
the  manufacturing  process.  Gerwm  has  developed  a  useful  taxonomy  of  flexibility 

consisting  of  six  sets  of  uncertainties,  strategic  objectives,  and  corresponding 
flexibilities.  The  first  four  relate  to  uncertainties  in  the  market;  the  last  two  to 
uncertainties  in  the  manufactiuing  process  (Gerwin,  1989,  pp.  79-82;  Gerwin  and 
Tarondeau,  1989,  pp.  171-172). 

Mix  Flexibility  fMixFlexl:  Uncertainty  as  to  which  products  will  be  bought  by  customers  leads 
to  mix  flexibility,  or  the  ability  of  a  manufacturing  process  to  produce  a  wide  variety  of 
products  without  resorting  to  time  consuming  setups  and  material  handling  delays.  Mix 
flexibility  is  associated  with  the  strategic  objective  of  product  diversity. 

rhang^nvpj  Flexibility  Uncertainty  os  to  the  length  of  product  life  cycles  creates 

a  need  for  changeover  flexibility,  or  the  ability  of  a  process  to  deal  with  additions  to 
and  deletions  from  the  mix  of  products  over  time.  Changeover  flexibility  is  needed  to 
meet  the  strategic  objective  of  product  innovation. 

Modification  Flexibility  fModFlexl:  Uncertainty  as  to  which  particular  product  attributes 
customers  want  creates  a  need  for  modification  flexibility,  or  the  ability  to  make  minor 
design  changes  in  a  given  product.  Modification  flexibility  meets  the  strategic  objective 
of  being  responsive  to  customers. 

Volume  Flexibility  fVolHexl:  Uncertainty  about  the  amount  of  aggregate  product  demand  leads 
to  volume  flexibility,  or  the  ability  to  change  the  aggregate  amount  of  production. 
Volume  flexibility  is  related  to  the  strategic  objective  of  building  or  maintaining  market 
share. 

Routing  Flexibility  fRoutFlexl:  Uncertainty  regarding  machme  downtime  gives  rise  to  routing 
flexibility,  or  the  ability  to  change  the  machining  sequence  for  a  part  when  breakdowns 
or  renovations  occur.  Routing  flexibility  is  needed  to  satisfy  the  strategic  objective  of 
meeting  customers’  due  dates. 

Material  Flexibility  fMatlFlexl:  Uncertainty  as  to  whether  inputs  to  a  manufacturing  process 
meet  standards  leads  to  material  flexibility,  or  the  ability  to  handle  unexpected  changes 
in  the  composition  and  dimensions  of  parts.  Material  flexibility  is  associated  with  the 
strategic  objective  of  product  quality. 

Manufacturing  Quality  fQualitvl:  The  ability  of  a  manufacturing  process  to  produce  acceptable 
output  without  defects  being  introduced  during  the  production  process.  A  goal  of  defect 
prevention  is  to  build  the  product  correctly  the  &st  time.  Automated  manufacturing 
improves  manufacturing  quality  by  using  in-line,  real-time,  automated  inspection,  which 
flags  potential  problems  before  defective  products  emerge.  The  integrated  database  helps 
errors  in  the  software  that  controls  manufacturing  to  be  detected  and  removed  after  the 
fiist  run.  Moreover,  reduced  direct  labor  content  leads  to  fewer  operator  errors  (CAM-1, 
1988,  pp.  82, 184). 


-  32  - 


Risk  (Risk'):  The  probability  that  an  investment  will  result  in  an  economic  outcome  different 
from  what  is  desired  or  what  is  expected.  This  is  properly  called  risk  exposure.  Risk 
attitude  is  the  willingness  of  decision  makers  to  undert^e  investments  cf  uncertain 
outcome  (Marshall,  1988,  pp.  ix-x).  Risk  attitude  can  be  incorporated  in  the  pairwise 
comparisons  with  the  other  criteria  in  the  model.  Four  types  of  risk  exposure  criteria 
related  to  automated  manufacturing  investments  follow  (CAM-1, 1988,  pp.  18S-186). 

Economic  Risk  fEcouRiskV  The  probability  that  using  a  candidate  technology  wiU  not  achieve 
the  projected  economic  benefits  because  of  legislative  trends,  inflation  rate  changes, 
mterest  rate  changes,  competition  from  other  companies,  or  time  and  resource 
constraints. 

Technological  Risk  (TechRiskl:  The  probability  that  a  technology  will  fail  to  achieve  the 
desired  manufacturing  benefits.  Higher  risks  are  associated  with  both  older  technologies 
(due  to  increased  probability  of  obsolescence)  and  leading  edge  applications. 
Technological  risk  factors  associated  with  leading  edge  applications  include  hardware 
failure,  software  failure,  lack  of  vendor  support,  and  communication  facility  failures. 

Implementation  Risk  (ImolRiskl:  The  probability  that  human  resource  factors  will  prevent 
successful  implementation  of  the  candidate  technology.  These  factors  include  employee 
attitudes  and  skills,  personnel  education  and  training/retraining,  employee  reward  system, 
organizational  impact,  and  compatibility  of  the  new  technology  with  current  operating 
procedures. 
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